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Quantum Dissipative Systems and Feedback 
Control Design by Interconnection 

Matthew R. James, John Gough 
Abstract 

The purpose of this paper is to extend J.C. Willems' theory of dissipative systems to the quantum domain. This 
general theory, which combines perspectives from the quantum physics and control engineering communities, provides 
useful methods for analysis and design of dissipative quantum systems. We describe the interaction of the plant and a 
class of exosystems in general quantum feedback network terms. Our results include an infinitesimal characterization 
of the dissipation property, which generalizes the well-known Positive Real and Bounded Real Lemmas, and is used to 
study some properties of quantum dissipative systems. We also show how to formulate control design problems using 
quantum network models, which implements Willems' "control by interconnection" for open quantum systems. This 
control design formulation includes, for example, standard problems of stabilization, regulation, and robust control. 

Keywords: Quantum feedback control, dissipation, damping, quantum feedback networks, control by intercon- 
nection, regulation, stabilization, robustness. 

I. Introduction 

In 1972 J.C. Willems [34] developed a general theory of dissipative systems for the purpose of stability analysis 
of open systems, that is, systems that may be subject to external influences, [36]. This theory generalizes Lyapunov 
methods that apply to closed systems, as well as important results in control theory including the positive and 
bounded real lemmas. The theory is widely used in control system analysis and design. In particular, methods for 
stabihty analysis, e.g. [21], [14], [15], control design by energy shaping, interconnection, robust control system 
design; e.g. [26], [32], [35], [36], [28], [37] have been developed. While Willems' theory applies to quite general 
nonlinear systems, it has its origins in classical physical systems and is based on describing energy storage and 
flows. As a simple example, consider the passive series RLC circuit of Figure [l] Energy V = f *^ + fb'^^ stored 
in the inductor and the capacitor (here, L is the impedance, C is the capacitance, q is capacitor charge, and i is the 
current). The external voltage v is related to the internal voltages hy v = vl + vj^, + vc, with vl ^ Lq, vr — Rq 
and Vc = ^q, and this determines the dynamical equation ^ ~ j-{v ~ Ri — ^q)- The rate of change of stored 
energy is given by 

V = -Ri^ + vi. (1) 
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The first term on the RHS is the energy dissipated by the resistor, and the second term is the power appUed to the 
circuit by an external source. This expression describes the balance of energy flows, and implies the inequality 



V < 



(2) 



which is an example (in differential form) of the dissipation inequalities considered by Willems. It says simply 
that the rate at which energy is stored must be less than the rate at which energy is supplied; the remainder being 
dissipated. Inequalities of this type are of fundamental importance to stability analysis of open systems. Furthermore, 
such inequalities can be exploited to facilitate control system design. Because of the emerging need for analysis 
and design methods for quantum technologies, the purpose of this paper is to develop an analogous framework for 
open quantum systems. 




Fig. 1. Series RLC circuit. 



The types of open quantum systems we consider include the optical cavity shown in Figure |2j which consists 
of a pair of mirrors (one of which is partially transmitting) supporting a trapped mode of light. This cavity mode 
may interact with a free external optical field through the partially transmitting mirror. The external field consists 
of two components: the input field, which is the field before it has interacted with the cavity mode, and the output 
field, being the field after interaction. The output field may carry away energy, and in this way the cavity system 
dissipates energy. This quantum system is in some ways analogous to the RLC circuit discussed above, which stores 
electromagnetic energy in the inductor and capacitor, but loses energy as heat through the resistor The cavity also 
stores electromagnetic energy, quantized as photons, and these may be lost to the external field. If V denotes the 
physical observable for the energy of the cavity mode, and if a laser beam is applied as an input w, then the energy 
dissipation relation for the cavity is of the form 

g{V)<z*w + w*z, (3) 

where z is a physical quantity of the cavity (notation is explained at the end of this section). The term g{V) plays 



the role of V , and is discussed further in sections 



II-A 



II-D 



This inequality relates the rate at which energy 



and 

is stored in the cavity to the rate at which energy is supplied, with the remainder being lost to the external field 
(which serves as a heat bath). 

Our principal goal in this paper is to formalize a notion of dissipation for open quantum systems in a way 
that is helpful for quantum control analysis and design by combining perspectives from control engineering with 
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input beam 




Fig. 2. A cavity consists of a pair of mirrors, one of which is perfectly reflecting (shown solid) while the other is partially transmitting (shown 
unfilled). The partially transmitting mirror enables the light mode inside the cavity to interact with an external light field, such as a laser beam. 
The external field is separated into input and output components by a Faraday isolator. 



perspectives from quantum physics. Indeed, phenomena of dissipation or damping are fimdamental in both physics 
and engineering, and have been the subject of extensive investigations. In physics, methods have been developed 
to model energy loss and decoherence (loss of quantum coherence) arising from the interaction of a system with 
an environment, or heat bath, [25], [42], [16], [9], [2], [10]. Open quantum models are unitary models that provide 
a description of the system of interest, or plant (e.g. optical cavity, atom, etc) as well as the environment (e.g. 
optical field), where the influence of the environment on the system may be described with the aid of quantum 
noise. These models preserve the essential nature of quantum mechanics, a feature of basic importance. 

Our modeling of dissipative quantum systems has its origins in the papers [7], [6], [4], [17], and represents 
inputs as the sum of a quantum noise term, used in physics to describe damping as mentioned above, and a signal 
term of the type used by WiUems to provide a means for the external world to influence the system. This signal 
plus noise representation arises in a natural way in the unitary models we use. The signal component of the input 
comes from the output of another system, which we call an exosystem. We develop our framework for quantum 
dissipative systems by using open quantum model descriptions of quantum networks, [12], [11], [8], [3], [40], [41]. 
We therefore employ a network description of a plant interacting with an exosystem. We aUow the exosystem 
to vary in a class of such exosystems, and the dissipation inequaUty we define is expressed in these terms. This 
network description turns out to be very appropriate and efficient, and was inspired by the behavioral "control 
as interconnection" perspective in WUlems' more recent work, [35], [36] (also [31], [30], [38]). We provide an 
infinitesimal characterization of the dissipation property, and this important tool is used indispensably in this paper. 
This characterization includes generalizations of the well-known Positive Real and Bounded Real Lemmas, and is 
used to study some properties of quantum dissipative systems. We show that essentially all open quantum systems 
are dissipative for a suitable choice of supply rate. This "natural" supply rate includes terms corresponding to the 
classical notion of passivity, a dissipation or damping term due to the quantum noise, and a dissipative term which 
is present in general when the exosystem does not commute with the plant. 

The framework we develop can also be used to describe how systems are influenced by controllers, and hence is 
useful for control design by interconnection, [35], [36], and various passivity-based methods [26], [32], [27], [28]. 
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We give a general description of how to formulate control design problems in these terms. This description includes, 
for example, standard problems of stabilization, regulation, and robust control. It is important to appreciate that 
because we express control design problems in terms of unitary models, the controllers obtained can (in principle) 
be physically realized — this is vital when we wish, for instance, the controller to be itself a quantum system, as in 
coherent control, [18], [39], [17], [24], [23], [19]. 

Note that issues of stability are important in the analysis and design of quantum networks. This is because quantum 
networks may contain active elements that introduce energy, and whenever this happens, stability of feedback loops 
in the network is a basic consideration (small gain theorem, [43], [44], [4]). Energy may be introduced by design, 
such as via an amplifier, or by accident due to undesirable environmental influences. It also plays a role in regulation 
of a system to a desired equilibrium mode of operation. 

We begin in section |ll] by describing the mathematical models for quantum feedback networks we use, which 
are expressed in terms of the quantum stochastic calculus, [16], [9]. This section includes some material aimed at 
helping orient the reader to the ideas, models and notation used in the remainder of this paper Our main definitions 
and results for quantum dissipative systems are given in section [Hi] which includes some examples for illustration. 



Section IV contains a formulation of control by interconnection methodology for quantum dissipative systems, 
which we illustrate using simple examples. The appendix contains some definitions and results needed in the paper. 

Background references. A number of articles and books are available to help readers with the background material 
on which the present paper is based. The papers [40] and [33] provide excellent introductions to aspects of the 
quantum models we use. The paper [1] is a tutorial article written to assist control theorists and engineers by 
providing introductory discussions of quantum mechanics, open quantum stochastic models, and quantum filtering. 
The book [10] is an invaluable resource for quantum noise models and quantum optics, while the book [29] provides 
a detailed mathematical treatment of the Hudson-Parthasarathy theory of the quantum stochastic calculus. The book 
[20] is a standard textbook on quantum mechanics. The papers [12] and [11] contain the basic results concerning 
quantum feedback networks used in this paper. 

Notation. In this paper we use matrices M — {m^} with entries that are operators on an underlying Hilbert 
space. The asterisk * is used to indicate the Hilbert space adjoint A* of an operator A, as well as the complex 
conjugate z* ~ x ~ iy of a complex number z = x + iy (here, i = \/— T and x, y are real). Real and imaginary 
parts are denoted Re(z) — {z + z*)/2 and lm{z) — -~i{z — z*)/2 respectively. The conjugate transpose of a 
matrix M is defined by = Also defined are the conjugate M* — {m*j} and transpose M'^ = {rriji} 

matrices, so that = {M'^)* = (Af*)^. In the physics literature, it is common to use the dagger f to indicate 
the Hilbert space adjoint. The commutator of two operators A,B is defined by i?] = AB — BA. S{-) is the 
Dirac delta function, and Sjk is the Kronecker delta. The tensor product of operators A, B defined on Hilbert 
spaces H, G is an operator A^ B defined on the Hilbert space H (g) G (tensor product of Hilbert spaces) defined 
by {A (g) B) {tp (E) (j)) = (Atp) ^ (Be/)) for ip ^ H, (fi £ G; we usually follow the standard shorthand and write simply 
AB = A (g) i? for the tensor product, and also A ^ A<^ I and B ^ 1 B. 
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II. Preliminaries 

A. The Classical RLC Circuit Revisited 

Before embarking on a description of the class of open quantum systems considered in this paper, we revisit the 
simple classical RLC circuit of Figure [T] in order to provide some conceptual and notational connections with the 
quantum theory. We may choose the charge and current as the "state variables" for the circuit. That is x = (g, i)-^ give 



global coordinates for the state space manifold which is here a phase-plane, and the trajectories are then the solutions 

dq di 

Alternatively, the trajectories x{t) — {q{t), i{t))'^ can be thought of as the integral curves to the tangent vector field 



to the system of equations — = wl{q,i), — — wl{q,i), where 'w'l{q,i) — i and wl{q,i) — j^{v — Ri ~ ^q). 



d d 

Wy{q,i) ^wl{q,i)— + wl{q,i) — ; (4) 
i.e. solutions to the differential equation 

X = Wv{x). (5) 

Note that we need to prescribe the value of the external voltage v, possibly as a function of time, and that w„ 
actually corresponds to a family of tangent vector fields generating a controlled flow. 
For an arbitrary smooth function f{x) — f{q, i) of the state, we have by the chain rule 

d dfdf 

-/(x(t)) = w1{x{t))^{x{t))+wl{x{t))J.{x{t)), (6) 

or in compact form 

f^Gvif) (7) 

where Gv{f) is the directional derivative operator 

- V/-u-„. (8) 

In particular, the stored energy V — ^i^ + ^q^ is a quadratic function of the state variables, and the energy 
balance equation ([T]l is obtained from setting f = V: 

l/ = e„(l/) =r"(«), (9) 

where r°(t>) is the function ~Ri^ + iv on the phase plane, also dependent on the input voltage v. 
The energy balance relation ([TJ and dissipation inequality (j2| become 

g,{V) - r%v) = 0, (10) 

and 

gAV)-r{v)<0, (11) 

where the respective supply rates are r°(u) = —Ri^ + iv and r{v) — iv. If we regard the voltage v as an input 
and the current i as an output function of the phase space variables, then it can be seen that the supply rates are 
functions of the phase space variables and the input. 
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Functions / f{q, i) of the phase space variables correspond to the physical variables of interest, and are basic 
to any description of classical mechanics. When considering open physical systems, such as the RLC circuit, or the 
open quantum systems discussed in this paper, it is helpful to have a notation for indicating to which physical system 
a physical variable belongs. If we write s^ulc for RLC circuit physical variables (the set of smooth functions on 
the phase space manifold) then this is in fact a commutative algebra which may be extended to a ^-algebra by 
taking complex-valued functions with the choice of complex conjugation as the ^-operation. Likewise we could 
write £/ex for functions of the external variables v. We then see that the energy function V belongs to s^^rlc- The 
supply rates however belong to the algebra of functions over both state variables and external variables, the tensor 
product s^RLC ® s^ex, so that r°,r e si^rlc ® s^ex- In the quantum setting, these algebras will be non-commutative 
(in fact algebras of operators over Hilbert spaces). 

The crucial observation is that the energy balance relation ([T]l and the dissipation inequality Q are to hold for 
aU input signals v. This can be re-expressed as saying that ([TJ and Q hold for all external signal generators v, 
as shown in Figure [3] This leads to an interpretation of energy balance and dissipation inequalities in terms of an 
interconnected system consisting of the principal system of interest (the RLC circuit) and an exosystem (the signal 



generator). This interpretation will be used in the quantum context in section III below. 




L 

C 



Fig. 3. Series RLC circuit connected to an external signal generator. 



B. Quantum Mechanics 

In quantum mechanics [20] physical quantities like energy, spin, position, etc., are expressed as observables; 
these are represented as self-adjoint operators acting on a Hilbert space H. Other physical variables, like annihilation 
operators (see Appendix |B]i — which are not self-adjoint — are also of importance. We will use the notation jz/ to 
refer to the collection of physical variables for a system (in general jz/ is a non-commutative *-algebra). We refer 
to si/ as the physical variable space for the system. Unit vectors ■(/; e H are called state vectors. When a quantum 
system is in a state defined by a state vector ?/; e H, the expected value of an observable A E £/ is defined in 
terms of the Hilbert space inner product: {tp,Atp). In what follows we use the shorthand notation (A) to denote 
expectation when the underlying state is understood. 

The postulates of quantum mechanics state that for a closed system the evolution of states and observables are 
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given in terms of a unitary operator U {t) satisfying the Schrodinger equation 

if = -iHU, (12) 

with initial condition U{0) = / (the identity). Here, H is an observable called the Hamiltonian, and represents 
the energy of the system. State vectors evolve according to t/ij — U{t)ip. Alternatively, we may view state vectors 
as fixed in time, while observables are taken to evolve according to A{t) = U* {t)AU{t): this is the Heisenberg 
picture. Both pictures are equivalent and the average of an observable A in state ip at time t is given equally by 

In this paper we are interested in open quantum systems - systems that interact with other systems or an 



environment. These systems will be defined in section Il-D in terms of a stochastic generalization of the Schrodinger 



equation ( [T2] l involving quantum noise. Before considering these open system models, we look at a simple situation 
of two interacting systems in the next section. 

C. A Pair of Interacting Systems 

Consider a pair of independent systems P (the plant) and W (the exosystem, or signal generator). The physical 
variable spaces for these systems are denoted jz/p and respectively, and consist of operators defined on 
underlying Hilbert spaces Hp and Hw respectively. The physical variable space for the combined system is the 
tensor product £/p (g) s^w^ consisting of operators on the Hilbert space Hp ® Ww- All operators in s^p may be 
regarded as operators in jz/p ® sz/w by identifying Ap with Ap ® and similarly for £/w As a consequence, 
all variables in £/p commute with all variables in jz/w 

Let Hp £ -s^p and Hw e £/w be the Hamiltonians for each of the systems, respectively; this would be enough 
to specify their dynamics as isolated, closed, systems. However, we allow them to interact by exchanging energy 
as specified by the interaction Hamiltonian 

Hpw ^ ~i{K*v-v*K), (13) 
where K £ s^p and v £ s^w- The total Hamiltonian for the combined system is H = Hp + Hw + Hpw, and the 



dynamics are given by the Schrodinger equation ( 12 1 using this total Hamiltonian. 

Now let's consider the effect of the exosystem W on the plant P. Let V £ £/p be a non-negative observable 
that commutes with Hp. Then from ( [T2| we see that V evolves according to 

V = ~i[V,H] 

= v*[V,K]-[V,K*]v 

= Z*v + v*Z, (14) 



where Z = [V, K] £ sip. From this we see that P is lossless, with the RHS of (14 1 giving the net rate at which 



energy is delivered to P from W (cf [32, eq. (2.39) and Chapter 4], and section [ni-A| below). 
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In the general framework we present in this paper (section III i, P is an open system, and W may be connected 



to P via field connections in addition to direct couplings of the form ( 13 1. Open quantum systems are summarized 



in section |II-D| and mechanisms for interconnecting them are reviewed in section |II-E| 



D. Definitions 

We consider an open quantum system G with physical variable space ^/q consisting of operators X defined 
on an underlying Hilbert space Hq. The self-energy of this system is described by a Hamiltonian H E jz/q. This 
system is driven by a collection of n field channels given by the quantum stochastic processes 





1 




] 




1 


All . 




\ 


A = 








, A = 












[ 


An 


) 




[ 


Anl ■ 


A 


J 



These respectively describe annihilation of photons in the field channels, and scattering between channels, and are 
operators on a Hilbert space F, with associated variable space Specifically, F is the Hilbert space describing an 
indefinite number of quanta (called a Fock space [29]), and is the space of operators over this space. We assume 
that these processes are canonical, meaning that we have the following non-vanishing second order Ito products: 
dAj (t) dAk {ty = Sjkdt, dAjk (t) dAi (t)* = SkidAj{t)\ dAj (t) dAki (t) = Sj^dAi^t) and dA^k (t) dA^^ (t) = 
5kidAjm{t)- The simplest situation corresponds to that of a vacuum state (p E f for the field channels, in which 
case the input processes are purely quantum noise. 
Coupling of the system to the field is defined using 
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respectively a scattering matrix with operator entries Sij G satisfying S = SS^ — I, and a vector of coupling 
operators Lj G £/q. 

In terms of the parameters G = {S, L, H), the Schrodinger equation 

dU{t) = i^v[{S - I)dK\ + dA^L- L^SdA-]^L^Ldt-iHdt^U{t) (15) 

with initial condition [/(O) = / determines the unitary motion of the system, in accordance with the fundamental 
postulate of quantum mechanics. Given a system operator X £ jz/q, its Heisenberg evolution is defined by X{t) — 
i^{X) ^U{t)* XU {t) and satisfies 

dX{t) = {CL(t){X{t)) - i[X{t),H{t)])dt 
+dA\t)S\t)[X{t),L{t)] + [L\t),X{t)]S{t)dA{t) 

+tr[{S\t)X{t)S{t) - X{t))dK{t)]. (16) 
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In this expression, all operators evolve unitarily (e.g. L{t) — it{L)) (commutators of vectors and matrices of 
operators are defined component-wise), and tr denotes the trace of a matrix. We also employ the notation 

£l{X)=^L^X,L] + ^[L\X]L. (17) 

In what follows we write 

gG{X) = -t[X,H] + CLiX) (18) 

for the generator of the plant G. The components of the output fields are defined by A{t) = it{A{t)) ^ U* {t)A{t)U{t), 
A{t) = jt(A(t)) = U* {t)A{t)U{t) and satisfy the quantum stochastic differential equations 

dA{t) = S{t)dA{t) + L{t)dt (19) 
dA{t) = S*{t)dA{t)S'^{t) + S*{t)dA*{t)L^{t) (20) 
+L{t)dA{t)S'^(t) + L*{t)L^{t)dt, (21) 

where L{t) =\t{L), etc., as above. The output processes also have canonical quantum Ito products. 

It can be seen that the parameters G — {S, L, H) provide a compact specification of the open system, assuming 
canonical field inputs, since they determine the behavior of the system, via the flow jf( ), as determined by the 



J 



Schrodinger equation (15 1. In the case of a purely static system, we sometimes use the shorthand S — (S*, 0,0). 
Important special cases are / = (/, 0, 0), the trivial (identity) system, and J = (J, 0, 0), where 

1 

1 

If -0 G Hg is an initial system state vector, then with vacuum fields the state vector of the complete system 
is ip ® 4). Then the quantum expectation {X{t)) is defined to be {tp (g) 4>,X{t)'ip ® (f)). In order to describe how 
quantum noise beyond time t is averaged out, we introduce a collection {=^f} of physical variable spaces such that 
C <8i ^ is generated by operators in and the quantum noises Aij{s), s < t. Then X{t) is adapted, i.e. 
X{t) E ,^t, and = ■^G- There is an associated vacuum expectation E( : s^g ® ^ ^ [29, Chapter 26] with 
respect to which the open dynamics satisfies 

E,[X(t)] = X{s) + [ Es [GG{X{r))] dr (22) 

J s 

for all i > s. In this expression Es[X(i)] depends on the initial operators and the quantum noises up to time s, 
while the noises beyond time s have been averaged out; it captures the Markovian nature of the model. 



E. Quantum Feedback Networks 

In this section we describe a quantum framework for feedback networks that will be used in the sequel, [12], [11]. 
Quantum feedback networks (QFN) consist of open quantum components that are interconnected by means of field 
channels that serve as "quantum wires". These channels enable the directional transmission of quantum signals, 
thereby allowing the components to interact; the components may also interact directly via suitable couplings 
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that facilitate bidirectional energy exchanges, as discussed in section II-C Here we focus on the directional 
interconnections. The QFN framework is expressed in terms of elementary constructs that enable efficient description 
of networks. These network constructs are defined in terms of the open system parameters {S, L, H) discussed in 
section II-D As we will see, the framework generalizes the familiar transfer function descriptions widely used in 



classical linear systems theory; however, we emphasize that the QFN framework holds for general open quantum 
components whose dynamical variables may evolve nonlinearly (by this we mean that the differential equation for 
a component operator X{t) may be nonlinear). 

QFN modeling proceeds as follows. Before implementing any connections, we first collect the components 
together. This is described using the concatenation product ffl. Figure |4] Next, we identify any series connections 
between components, which we describe using the series product <i. Figure [5] Networks that can be completely 
described using the concatenation and series products are called reducible networks (these were studied in detail 
in [12]). Any remaining signal connections will form part of a feedback loop that can be described in terms of a 
linear fractional transformation, F{G) [11]. All direct couplings between components can be accommodated using 
an interaction Hamiltonian of the form ( [T3] l. 

Suppose we are given two such systems: Gi — {Si,Li, H) and G2 = (S'2, L2,H), with physical variable spaces 
£/g-^ and £/q^ , respectively. The products we define below combine these systems to produce new systems defined 
in terms of parameters drawn from the tensor product of variable spaces £/gi ^ ^^02 ■ 

The concatenation of Gi and G2 is the system Gi ffl G2 defined by 



Gi ffl G2 = ( 



Si 



S2 I \ L2 



,m + H2), 



(23) 



as illustrated in Figure |4] (where each arrowed line may represent multiple channels). It is possible to include 
zero-dimensional inputs into this scheme as a special case: if a system in isolation has no inputs then it is a 
closed dynamical system and its dynamics are described by a Hamiltonian H. It is convenient just to write this as 
G — (_, H) with the absence of inputs denoted by blanks; we then just set (_, H) ffl (_, H') :— (_, -,H + H') 
and more generally (_, _, H) ffl (S", L' , H') = [S' , L' , H') ffl (_, _, H) := (S", L' , H + H'). 




Fig. 4. Concatenation of two systems, Gi ffl G2- 



Now suppose Gi — {Si,Li,H) and G2 — {S2,L2,H) have the same number of field channels (i.e. Li and L2 
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have the same length). Then the series product G2 < Gi is defined by 

G2 < Gi = {S2Si,L2 + S2Li,Hi + H2 + lm{LlS2Li} 

see Figure |5] 



(24) 




Fig. 5. Series or cascade connection of two systems, G2 < Gi. 



Several useful facts concerning the series product are the following: (i) given a system G = {S,L,H), we 
have G = {I,L,H) < (S*, 0,0) = (S", 0, 0) o {I , L, H), (ii) the inverse of a system G exists and is given by 
G-i = {S\ -S^L, -H), by which it is meant that G^^ < G = G < G^^ = I = {1, 0, 0), and (iii) for any two 
systems Gi and G2 we have G2 <i Gi = Gi < G2 where G2 = Gj^^ < G2 < Gi (S'j525i, Sl{S2 - I)Li + 
S\L2,H2 + Iiii{L\{S2 + I)Li - l\S2Li}). 

For future reference, we mention that the generators for the systems formed with the concatenation and series 
products are 

QG,mG,{X) = CLAX) + CL,{X)-i[X,H^+H2]=gG^{X) + gGAX), (25) 
Qg,^g^{X) = CL,+s,LAX)~i[X,H^+H2+^{LlS2L^-L\slL2)] (26) 
= Cs,L, {X) + Cl, {X) + l\sI [X, L2] + [4, X]S2L^ - i[X, + H2] 
= ClAX) + Cl,{X) + l\{sIxS2 - X)L, + l\sI[X,L2] + [lIx]S2L, - t[X,H, + H2]. 
Next, consider a system G of the form 

G^(( ^" ^''] ( h] (21) 

\\S21 S22 )\L2 )' 

The feedback network F{G) defined by Figure |6] is well-defined provided / — 5*22 is invertible, in which case the 

parameters for F{G) are given by the linear fractional transformation [11] 

F{G) = {Sn + Sr2{I - S22)-'S2i, £1 + 812(1 - 522)-'i2, 

H + lm{L\Si2{I - S22r'L2} + lm{LlS22{I - ^22)"'i2}). (28) 

Remark 2.1: Underlying the series and LFT network constructs is the simple idea of equating the input U2 with 
a slightly delayed version of the output y2, and then letting the delay tend to zero. Full technical details are given 
in [10], [12], [11]. □ 
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Fig. 6. Quantum feedback network described by the linear fractional transformation F{G). 



III. Quantum Dissipative Systems 

We are now in a position to introduce a general definition of dissipation for open quantum systems. As we have 
indicated above, since dissipation concerns the loss of energy or coherence from a system of interest, which we call 
the plant, to an external environment, or the effect of an external system or environment on the system, we model 
the external influences as another open system, which we call an exosystem. Since we wish to consider the effect 
of a range of exosystems (analogous to a range of signal generators connected to an RLC circuit), we specify a 
class of allowed exosystems for the dissipation property. The definition, together with some examples, is presented 



in subsection III-A using the QFN framework from section II-E 



A. Definitions and Differential Characterization 



A plant P is an open system of the type defined in subsection II-D 



P=iS,L,H). (29) 

It is the system of main interest, and is regarded as being part of a possibly larger network of systems. The space 
of physical variables for P is denoted £/p. Since our interest is in modeling and analyzing the effect of the external 
influences on the plant, we assume that certain of its input and outputs are available for connection to an exosystem 
W, an open system 

W={R,w,D). (30) 

It is also assumed that certain plant variables are available for direct interconnection with an exosystem. Thus the 
plant definition and interconnection specification determine how it can interface with exosystems W, as discussed in 
subsection II-E The interconnections determine a network P /\W, as shown in Figure |7] (a star product architecture. 



[13], [44], [II]). In terms of the network constructs of section II-E we have explicitly 

P AW = F{G)mHpw, (31) 

using the LFT (Figure [6]l, where 

G= (/ffl J)<](iyffl/)<(/fflP)<(/ffl J), (32) 
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as shown in Figure |8] and Hpw is a direct interaction Hamiltonian. 

We will allow exosystems W to vary in a class W of such exosystems. The operators constituting the system 
parameters W belong to an algebra £/p ^ .s/ex- The input to the system P A W is assumed to be a canonical 
vacuum field. 



Fig. 7. The plant-exosystem network P A W. 




Fig. 8. The system G used to represent the network P AW of Figure |7] 



Let r = rp{W) G £/p (g) £/ex be a self-adjoint symmetrically ordered function of the exosystem parameters, 
depending on the plant parameters (e.g. a quadratic form), called a supply rate. In general, a supply rate may contain 



constant terms (see Example 3.10i. 

We say that the plant P is dissipative with supply rate r with respect to a class W of exosystems if there exists 
a non-negative plant observable V G £^p such that 



En 



V{t) - V 



r{W){s)ds 



< 



(33) 



for all exosystems W G W and all t > 0. Here, the dynamics is that of the network P A W, Eg is the initial 
vacuum expectation onto £/p (E) ^/^x (which contains £/p), and < denotes operator ordering, see Appendix |C] 



We shall refer to (33i as the dissipation inequality. It is a natural generalization of Willems' definition [34] to 



open quantum systems, building on [6], [17]. Following the terminology from [34], when equality holds in (33i for 



all exosystems W e W, we say that the plant P is lossless. This terminology refers to the fact that in such cases 
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all energy flows and storages have been accounted for; the total system (plant, exosystem, fields) does not loose 
energy. Important special cases and applications of the dissipation inequality will be discussed below. 

We next present the infinitesimal version of the dissipation inequality ( [33] l in the following theorem. 

Theorem 3.1: Let P be a plant, and P /\W he a given network structure for a class W of exosystems. Then 
the plant P is dissipative with supply rate r with respect to W if and only if there exists a non-negative system 
observable V ^ s/p such that 

Gp^w{V) - r{W) < (34) 

for all exosystem parameters W £ W . 

Proof: Assume P is dissipative as stated, and select any exosystem W £W and consider the plant-exosystem 
network P A W . Now apply ( [22| to the network to obtain 

^MV{t)]\t=a = Gp^wiV). (35) 
at 



Now combine this with (33i to obtain (34i. The converse follows by reversing this argument and integration. 



Note that the dissipation inequality ( 34 1 involves only plant and exosystem operators, since the LHS depends on 
operators in the algebra ® sz/^x (the noise has been averaged out by Eg). 

Remark 3.2: (Non-autonomous case.) For non-autonomous situations, the plant and exosystem operators may 
depend on time (they can even be random provided they are adapted), and the dissipation inequalities take the 
forms 



E, 



V{t)-V{s)- / r{W){r)dr 



< (36) 



for all t > s and all exosystems W E W, and 

gpAw{V){t)-r{W){t) <0 (37) 

for all t > and all exosystem parameters W G W. □ 

In general we can expect physical systems to be dissipative in some sense, and indeed we characterize this 
precisely in the next theorem. In what follows we denote by 5^ the class of exosystems without any particular 
constraints (unrestricted) — the only requirement is that members of Wu are open systems that can be connected 
to the plant. The following simple (but important!) result follows from a calculation similar to that used to prove 
Theorem 13.11 

Theorem 3.3: Let P = {S,L,H) be a plant, and P A be a given network structure for the class Wu of 
(unconstrained) exosystems. Assume there exists an observable Vq > commuting with H. Then P is lossless 
(hence dissipative) with respect to for a supply rate r = tq given by 

r^(W) = ePAM/(K)), (38) 

with storage function V — Vq. 
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Theorems 3.1 and 3.3 are quite general, and contain many special cases of interest, e.g. versions of the Bounded 
and Positive Real Lemmas, as well as fundamental energy balance properties of physical systems. See Theorems 
m and O below. 



It is instructive to examine the form of that "natural" supply rate tq (defined by (38l) for the specific intercon- 
nection between the plant P — (/, L, H) and exosystems given by the series connection 



P AW = P<iW, 
and where the Hamiltonian D of the exosystem has the form 

D = -i{K^v -v^K), 
where K G jz/p is fixed and v commutes with ^p. Then we have 

L 



(39) 



(40) 



CM) + i^dv^) + { ) [Vo. 




] + [ it 




where 



Z = [M), 



L 



(41) 



(42) 



This means that the plant P — (/, L, H) satisfies the lossless energy rate relation 

Qp^w{V^) = CM) + -ClC^^o) +{w^ v^)z + Z^ 




(43) 



This relation may be regarded as a generalization of the well-known passivity relation for classical Hamiltonian 
systems (see, e.g. [32, eq. (2.39) and Chapter 4])[^If we think of Z as an "output" quantity (not necessarily part of 
an output field channel!), then the last two terms correspond to a product of input and output terms, i.e. an energy 
flow into the plant from the exosystem — these terms capture the passivity of the plant, as we now explain. The 
term ^^(Vb) is known in quantum physics as a "dissipation" or "damping" term, which in the model arises from 
the quantum noise in the field; when negative, this term represents energy lost from the plant to the field (heat 
bath). The first term, £^(Vo), arises from a "dt" or "signal" term in the field inputs, and is in general zero when w 



commutes with plant operators; it is an exosystem partner to the field dissipation term. Indeed, if we integrate (43 1 
and take expectations with respect to a joint state consisting of a plant state vector t/jq for which (tAq, VqV-'o) = 



'For a classical Hamiltonian system with Hamiltonian H = Ho + Gu, we have dHo/dt = {Ho,H} = zu, where u is an input and 

1 
-1 



{Ho, G} is an output (here the Poisson bracket is defined by {/, g} = fTiSJ g, where S : 
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and the vacuum state for the network input fields, we find that 



w{s) 
v{s) 

which generahzes well known passivity inequalities. Passivity and gain will be discussed in more detail in section 



{CUVo){s) + Cl{Vo){s) + ( wHs) v^s) ) Z{s) + Z\s) \ ])ds>0, (44) 

\ 



III-C which also contains illustrative examples. 



B. Stability 

In the case of classical deterministic systems, dissipativity plays an important role in stability analysis, [34], 
[14]. For instance, strictly passive systems are asymptotically stable. The purpose of this section is to make this 
connection in our current quantum context using a simple exponential stability criterion, given in the following 
lemma. 

Lemma 3.4: Let P be a plant for which there exists a non-negative observable V satisfying the differential 
inequality 

gp{V) + cV<\, (45) 
where c > and A are real numbers. Then for any plant state we have 

{V{t)) <e-^'(V)+X/c. (46) 

Moreover, if A = then limt^oo{V{t)) = 0. 

Proof: Integrating the plant dynamics we find that 



t+h 

V{t + h)-V{t)-c I V{r)dr 



< A/i, {h>0). (47) 



Now from [29, sec. 26], we have EoEf = Eq for < > 0, hence it follows that the expectation {V{t)) = {4>, Eo[V{t)]il;) 
(ip is the plant state) satisfies 

rt+h 

{V{t+h)) - {V{t)) - c j {V{r))dr<\h, {h>Q). (48) 

From this we deduce 

j^{V{t))<-c{V{t))+\. (49) 

The assertions of the lemma now follow. ■ 
We now state a stability result for strictly dissipative systems. 

Theorem 3.5: Let P be dissipative with storage function V and supply rate r{W). Assume that the supply rate 
satisfies 

r{I) < -cV (50) 

for some real number c > 0. Then for the unperturbed plant P — P < I we have limt^ao{V{t)) = for any plant 
state. 

This result follows, of course, from Lemma [3741 and Theorem ] 3. 1| It is possible to consider more general stability 
results and this will be taken up in future work. 
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C. Passivity and Gain 



In this subsection we consider passivity and gain properties for the series plant-exosystem interconnection, (39i. 
In particular, we present generalizations of the positive and bounded real lemmas (Theorems |3.6| and |3.7| below). 
To help make the ideas clearer, we will assume that the exosystems commute with the plant. More general results 
can be formulated using the framework developed in this paper. 

Consider a plant P = {I, L, H), and let N, Z E si/p. Define a class of exosystems 

Wi — {W = {R, w, —i{K^v — K)) : K G is fixed and w, v commute with ^p} . 
We say that P is passive (with respect to Wi) if it is dissipative with respect to the supply rate 

r{W)=r{w,v)^-N^N+(^w^ „t)z + Zt^"'j+A (51) 

for some non-negative real number A. Explicitly, this means that P is passive if there exists a non-negative system 
observable V E s^p and a non-negative real number A such that 



En 



V(t)-V-\(\ y \z{s)^Z\s){w{s) v{s)\-N\s)N{s))ds 



\t<0 (52) 



for all exosystems W E Wi and all t > 0. 

Theorem 3.6: (Positive Real Lemma) A plant P = {I, L, H) is passive (with respect to Wi) if and only if there 
exists a non-negative system observable V E s^p and a non-negative real number A such that 

£^(1/) +iV^iV- A < 0, (53) 

^=[^, l^^j]. (54) 

Proof: We use some results from the Appendix in what follows. If P is passive, there exists a non-negative 
system observable V E s^p and a non-negative real number A such that 

>Cl(F) - n\ \ ([^' ^] - ^) + ([^^ y\-Z^)(^w f ) + N^N - A < (55) 



for all exosystem parameters W — {R, w, —i{v^K — K^v)) E W^. Setting w = and t; = we obtain (53 i. Now 



let w vary freely but commuting with plant operators to deduce (54l ■ 
The Bounded Real Lemma is used to determine the gain of a system, and in conjunction with the Small Gain 
Theorem, can be used for robust stability analysis and design, [13], [44], [4]. Again consider a plant P ~ (1, i?), 
let N, Z E £/p, and let g > be a real number (gain parameter). In order to simplify the exposition, we restrict 
our attention to the class 

#2 = {W = {R, w,0) : w commutes with s/p} . 
We say that P has gain g (with respect to W2) if it is dissipative with respect to the supply rate 

r{W)^g^w^w~{N + Zw)\N+Zw) + \ (56) 
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for a real number A > 0, and class #2; i-C- there exists a non-negative system observable V G and a non-negative 
real number A such that 



Eo 



V{t)-V- 



{g^w^s)w{s) - (iV(s) + Z{s)w{s)y{N{s) + Z{s)w{s)))ds 



Xt<0 



(57) 



for all exosystems e #2 ™d all t > 0. 

Theorem 3.7: (Bounded Real Lemma) A plant P = {I,L,H) has gain g (with respect to #2) if and only if 
there exists a non-negative system observable V £ s^p and a non-negative real number A such that 



r = 5^ - z^z > 



and 



- i[V, H] - w^Tw + w^{[V, L] + Z^ N) + {[V, L] + Z^N)^w + N - A < 
for all exosystem parameters w. If T^^ exists, then P = {1,L, H) has gain g (with respect to W2) if 
Cl{V) - i[V, H] + N^^N + ([L^ + N'' Z)T-\[V, L] + Z^ N) - A < 0. 



(58) 



(59) 



(60) 



Proof: If P has gain g, then there exists a non-negative system observable V E s^p and a real number A > 
such that 



£l{V) - i[V, H] - w^Tw + w^{[V, L] + Z^ N) + {[V, L] + Z^N)^w + N - A < 



(61) 



for all exosystem parameters w. From the Appendix we see that F > 0, hence ( [58] l. In equality (59i also follows. 
Next, if exists, define 

w* ^T-\[V,L] + Z'fN). (62) 

Then by completion of squares 

-w^Tw + w^iV, L] + Z^N) + {[L\V]+ N^Z)w 
= {[L\V] + N^Z)T-\[V, L] + Z^N) - (w - w*)^r(w - w*) 
< {[L\ V] + N^Z)T-\[V, L] + Z^N). 



This inequality and (6O1 imply (59i as required. 



Remark 3.8: Note that the "optimal" exosystem parameter w* defined by (62i belongs to £/p, and so does not in 
general commute with £/p, and consequently lies outside the class of exosystems under consideration; i.e., w* 
in general. □ 

We conclude this section with several examples. The first example is that of a two-level system. Appendix |A| 
Example 3.9: (Two-level atom) In this example we consider an open two level atom 

where a^, <Jy, cFz denote the Pauli matrices (Appendix [Xji and a± = ^(o'a; ± i<Jy)- 
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Consider the storage function Vq — <ti — ^{I + <Tz) > (here / is the 2 x 2 identity matrix). Then by (41 1 we 
have 

ro{W) = -jai - y/j{w*a- + a+w) + Ciai<yi) - i[cri,D] 

= -{\/j(J- + w)*{y/ja- + w) + w*w + CuiitJi) ~ i[(7i, D]. (63) 
Therefore this system is lossless (passive), and has gain 1 with respect to the output quantity J^O- + w and 



commuting inputs w. When D — ^ and W — (1,0,0), then by Theorem 3.5 the expected value of Vo(i) — <Ji{t) 
tends to zero (asymptotically stable). □ 

The next example looks at open quantum oscillators. Appendix [B| 

Example 3.10: (Open Oscillator) Consider the plant 

P — (1, aa + (3a* , tja*a), 

where a is the annihilation operator (satisfying the commutation relations [a, a*] = 1, recall Appendix [b]i, a and 
(3 are complex numbers, and cj is a frequency parameter. The case a = (3 = corresponds to a damped 
cavity with coupling L = \/l o,, while the undamped oscillator model for an atom using in [5] has coupling 
L = ^/k (a + a*) for which a = /? = ^/k. The coupling L = a* arises in amplifier models, [10]. 



With Vq — o*a and W = (1, w, 0), from (41 1 we have 

ro(VK) = + iW - W?)Vq + w*Z+ Z*w + |/3p, (64) 

where Z = —aa + Pa*. From this it can be seen that P is passive whenever — |ap < 0. Furthermore, if 



— jap < (strict passivity) and W = (1,0,0) it follows from Lemma 3.4 that the plant is stable, i.e. the 
expected value of Vq remains bounded. If in addition (3 = then the expected value of Vq tends to zero. 

In the strictly passive case we may complete the squares to deduce that the plant has finite gain. For instance, if 
a = y/j, (3 = (damped cavity) we have 

ro{W) = -{y/ja + w)*{y/^a + w) +w*w + Cyj{Vo) (65) 

and hence the system has gain 1 relative to the output quantity ^ a + w and commuting inputs w. 

If |/3p — |ap > 0, the plant is not passive and not stable. The case — |ap = is marginally stable. □ 
The final example of this section concerns classical deterministic systems, of which the RLC circuit discussed 



earlier is a special case (see section II-A i. 

Example 3.11: (classical deterministic systems) Consider the classical deterministic open system (see [34], [32]) 

i = f{x) + g{x)w 

z = h{x), (66) 

where x E M", w E ^^^^([O, oo), M^), W C M., f and g are smooth vector fields, and ft, is a smooth real-valued 
function. This system is dissipative with respect to a supply rate r{w, z) if there exists a non-negative function (the 
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Storage function) such that 



V{x{t)) - V{x{0)) - / r{w{s),z{s))ds < (67) 
for all w e i^[0,<] and all t > 0. The infinitesimal version of this dissipation inequality is 



sup {[fix) + g{x)wfVV{x) - r{w, h{x))} < 0. (68) 

This is a special case of the quantum formulation given above. To see this, we represent the classical open system as 
a commutative subsystem of a quantum open system P with an associated (non-autonomous) exosystem class W. 
As in [12, Appendix B], we take the underlying Hilbert space of the classical system to be H = (M") with , 
Pj being the usual canonical position and momentum observables: q^ilj{x) = x^^{x) and pjip (x) — —idjtp{x). 
We write q = {q^, . . . , g")^, p— {pi, ■ ■ ■ ,Pn)^, and V = {di, . . . , dn)^ , and define Hamiltonians 



Hf = \ { fp + p'f) , Hg=\ {g'^p + p^g) . 



(69) 



Now if Lp = tp(q) is a function only of the position variables, then 

- i[ip, Hf + Hgw] = [/ + gwfVip. (70) 
Hence the classical open system can be described by P ffl W, where 

P = i-,-,Hf), 

W e W^{W^i.,.,Hgw) : weLl^{[0,cx,),W)}, (71) 

and supply rate 

r{W) = r{h,w). (72) 



The classical deterministic dissipation inequality ( [68] l now follows from (34i. In a similar way, one can also represent 
classical open stochastic systems, though we do not do so here. □ 

D. Dissipative Networks 

Dissipation properties for QFNs can be analyzed by considering how the network is constructed in terms 
of the elementary constructs (concatenation, series connection, direct interaction, LFT) and knowledge of how 
dissipation "transforms" under these constructs. This is the purpose of the following results. The first lemma 
considers concatenation and series connections. 

Lemma 3.12: Let Pi and P2 be given plants and Pi A Wi and P2 A W2 are network structures to be specified. 
Assume Pi and P2 are dissipative with respect to supply rates rp^{Wi) and rp^{W2), storage functions Vi and 
V2, and exosystem classes Wi and #2 respectively. Then: 

1) If Pi A Vt^i = Pi ffl Wi and P2 AW2 ^ P2WW2, then the network Pi ffl P2 is dissipative with respect to the 
network structure (Pi ffl P2) < W and exosystem class y^i ffl y^; the storage function is V = V1 + V2 and the 
supply rate is 

rp.BipMi ffl W2) = rp^iWi) + rp^{W2) + gp,^w,{V2) + Gp^^wAVi)- (73) 
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If Vi commutes with £/p^ and #2 and if V2 commutes with jz/p^ and #i, then then the supply rate is simply 
the sum of the supply rates: rp^ap.^{Wi ffl W2) — rp^{Wi) + rp^{W2)- 
2) If Pi A W^i = Fi <i Wi and F2 A VF2 = -P2 < W2, then the network P2 < Pi is dissipative with respect to the 
network structure P2<Pi<W and exosystem class 

W ^{W : P2 ^ e #1 and Pi < ly e W2}, (74) 

where P^ = Pf ^ <] P2 < Pi = {S\S2Si,Sl{S2 - I)Li + S\L2,H2 + Iui{l\{S2 + I)Li - L^Li}); the 
storage function is V = Vi + V2 and the supply rate is 

rp.^p, (W) = rp^ (P^ <W)+ rp^iPi < W) . (75) 

Proof: For part 1, we have 

G{PimP2)<iWiaw2){^i + ^2) = ^^(Pi<iWi)ffl(P2<iH'2)(^i + ^2) 

= Gpi^Wi (Vi) + Gp2<iW2 (^2) + Gpi<Wi (V2) + Gp2<W2 (14) 

< rp^{Wi) + rp^ ( VK2 ) + Gp,<w, {V2) + Gp2<W2 {Vi ) , 

so that the last line is a supply rate for the concatenated system. 
Similarly, for part 2 we have 

Gp2<Pi<w{Vi + V2) = Gp2<Pi<w{Vi) + Gp2<Pi<iw{y2) 

= ^Pi<l(P^<lVK)(^l) + 5p2<(Pi<lVK)(^2) 

< rp,{P^<W)+rp,{Pi<W) 

where P^ = P^^<P2<iPi - {SIS2S1, Sl{S2- I)Li + SlL2,H2 + lm{Ll{S2 + I)Li - l\S2Li}) ( [12, Theorem 
3.4]). ■ 
In the next lemma, we consider the dissipation properties of a LFT feedback system in terms of series plant- 
exosystem network structures. 



Lemma 3.13: Let P be a plant of the form (27i that is dissipative with supply rate r{W) and storage function V 
with respect to the network structure P<W and exosystem class W. Assume the LFT system P(P) is well-defined 
(Figure [6] section II-E 1. Define a class 



P(#') = {(l,u;,0) : {l,w,0)m{l,{I ^ S22)-\S2iw + L2),0) e W} 
Then P(P) is dissipative with storage function V and supply rate 

rFiP){W) = rp((l, w, 0) ffl (1, (/ - S22y\S2iw + L2), 0)) (76) 

for W = (1, w, 0) G F{W) relative to the network sti'ucture P(P) <i W. 

Proof: Let W — (1, w, 0) G F{W~), and consider the system P(P) < W . By elimination of the internal signal 
in the feedback loop, we see that 

W = (1, 0) ffl (1, (/ - S22Y^{S2XW + L2), 0) 
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is an admissible exosystem for P. The result now follows from the assumed dissipation property for P. ■ 
The next lemma describes how series architectures may be used to modify the plant and supply rates. 
Lemma 3.14: Let P and Q be systems for which the series connection P <i Q is well defined, and assume 

W implies Q <iW (md Q-^ <iW W. (77) 

Then the plant P is dissipative with storage function V and supply rate rp{W) with respect to W and series 
network architecture P <iW if and only if the plant P o Q is dissipative with storage function V and supply rate 
fp{Q< W) with respect to W and series network architecture P <iQ < W. 
Proof: The assertions follow from the relation 

Gp<Q<w{V)=rp{Q<W). 



As a consequence of Lemma 3.14 the scattering matrix S for the plant can be moved into the supply rate. 
Corollary 3.15: Let be a class of exosy stems satisfying 

W implies (5, 0, 0) < and (5"^ 0, 0) < G (78) 

Then: 

1) The plant P = (5, i, H) is dissipative with supply rate r{W) with respect to W series architecture P < W\f 
and only if the plant P' — (1, L, H) is dissipative with supply rate r'{W) — r{{S\ 0, 0) < W) with respect to 
W and series architecture P' < W . 

2) The plant P = {I,L,H) is dissipative with supply rate r{W) with respect to W series architecture P<Wif 
and only if the plant P' = (S", L, H) is dissipative with supply rate r'{W) — r{{S, 0, 0) < M^) with respect to 
W and series architecture P' < Vt^. 

The following example illustrates the use of some of the above results by considering the dissipation properties 
of a network analogous to [34, Fig. 1 and Theorem 5, sec. 4]. 

Example 3.16: Consider a network N consisting of n plants Pi, . . . , P„ interconnected via field channels and 
a static connection system T (with complex numerical entries). Figure |9] In terms of the notation of this paper, 
N = P(P), where P = P<(/fflf), P ^ Q2<{Pia ■ ■ - B P,,) <Qi, and f = Qi<T<Q3. Here, Qi,Q2,Q?,,Qa 
are appropriately sized permutation matrices (static components that interchange signals). 

We assume that the network N of Figure |9] is well-defined and that for j = 1, n let Pj = (/, L^, Hj) be 
dissipative systems with supply rates rj{Wj) and storage functions Vj with respect to the network structures Pj<iWj 
and exosystem classes Wj. Since the network N — F{P) has n input channels corresponding to the channels not 
involved in the interconnection, we may consider a series architecture N<iW, where W = SjWj with appropriately 
sized exosystems of the form Wj — {l,Wj,0). Then we can see that with respect to the network structure N <iW 
the network N is dissipative with storage function V = Vi + . . . + Vn as follows. 
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Fig. 9. (a) Quantum network A'^ formed by interconnecting systems with a static connection system T ( [34, Fig. 1]). (b) Equivalent representation 
of the networJc N = F{P < (/ ffl f )). 



First, by the first part of Lemma 3.12 we know that fflj-P, is dissipative with storage function V and supply rate 

i 

with respect to the network structure (ffljPj) < (SjWj), where Wj E Wj. Next, we write P = R< S where 

and Rj = (/, L^^O)) 0)- Here tt2 is the permutation corresponding to Q2- Now R is simply a re-arrangement of 
SjPj, and so it is dissipative with supply rate 

j 

where W — SWj, storage function V and series architecture. 

Write W = WjWj = fflj(/, w.j,0) and W = S <iW = (1, Sii, 0). Then P = R<S is dissipative with respect to 
the series structure P <iW with supply rate 



The supply rate for the network N = F(P) now follows from Lemma 3.13 The exosystem class can be determined 
from these calculations. □ 

E. Uncertainty Modeling 

Because of its importance to questions of robustness, in this subsection we briefly discuss how uncertainty can 
be modeled in the framework of this paper. However, a detailed treatment of robustness is beyond the scope of the 
present paper The plant-exosystem network architecture P /\W illustrated in Figure |7] together with a specification 
of exosystem class W provides a general scheme capable of accommodating a wide range of uncertainty models. 
Here for definiteness we set PA = P<iW, and consider a simple but common situation of parameter uncertainty. 



May 7, 2009 



DRAFT 



24 



Consider a plant P = (/, L, H), where 

L={\ + e)Lo, H = Ho + D. (79) 
Here e is a real parameter. Then using ( [24| we can write 

P = Po<W^iI,Lo,H)<iI,eLo,D), (80) 

which represents the plant P as a nominal system Pq with the uncertainty connected into it from an exosystem W 
containing the uncertainty terms. Note that P and W are not independent systems, and in fact share variables. 
The following example looks at the effect of parameter uncertainty on the behavior of the damped oscillator 



(recall Example 3.10 1 



Example 3.17: (Parameter uncertainty) As an example of this type of uncertainty modeling, consider the plant of 



Example 3.10 where a — and j3 — Q (damped oscillator). Uncertainty arises from the parameter values 7 and uo, 
which may not be known accurately. This type of uncertainty is common in quantum optics, where 7 is a measure of 
mirror transmissivity and uo corresponds to a detuning of the cavity relative to the input field. In the above notation, 
let Lq = -^/Toa. ^^0 = denote the nominal parameters, defining the nominal plant Pq = (1, a/To a, 0). a tuned 
cavity. Let the true parameters be L = (1 + e)w^a, H ~ uja*a, a detuned cavity P = (1, (1 + e)y/jQ a,uja*a). 



Hence the uncertain exosystem is W — (1, a,uja* a) (so that w = e^To a and D = uja*a). 



Then a straightforward calculation using (18 1 shows that 

Gp{a*a) = tjpn(a*a) — (e^ + 2e)7oa*a 
= -{l + efa*a<0. 

This means that the true system is always stable, regardless of the uncertainty, though the decay rate does change. 
This of course is expected of a passive physical system. 

However, other aspects of system performance may be affected. For instance, consider the quadratures q = a+a*, 
p = —i{a — a*), which are rotated by the detuning uj. Indeed, if we focus on the observable q^, then the uncertain 



exosystem contribution to the true generator (recall (1 8 1) is 



-i[q ,uja*a\ = uj{qp + pq), 

which depends on the detuning parameter ui. We see, therefore, that a detailed robustness analysis with respect to 
parameter uncertainty may involve consideration of one or more physical variables. □ 

IV. Feedback Control Design by Interconnection 

A. Control Design Formulation 

In the previous section we described how the behavior of plant is influenced by exogenous influences (represented 
as exosystems) using a quantum network framework. We now employ this same framework to consider problems of 
control system design. The network framework allows us to efficiently express a range of control design problems. 
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Indeed, in what follows we describe a control design procedure that extends classical methods including passivity- 
based control (PBC), "energy shaping" control, interconnection and damping assignment (IDA) PBC, and "control 
as interconnection", [26], [32], [27], [28], [35], [36], [31], [30], [38]. 

Let P be a plant which can be interconnected with a controller C and an exosystem in a network P l\C f\ W, 



Figure 10 as described in section II-E Given an exosystem class Wd we denote by "if a class of control systems for 



which such a network is defined. Since the network parameters P l\C l\W (together with the inputs) determine the 
dynamical evolution of the plant-controUer-exosystem network, control design can be thought of in terms of shaping 
the network dynamics in a desired way by appropriate choice of controller C € ^. Note that this framework is 
general enough to allow us to consider choices for the controller that are quantum, or classical, or a mixture of the 
two (cf. [17]). 




Fig. 10. The plant-controller-exosy.stem network P A C A W . 



It is worth remarking that the distinction between plant and controller is not always clear-cut. Indeed, the plant 
may need to be engineered in an appropriate way to facilitate control. For example, one may desire certain field 
couplings or direct interaction Hamiltonians to be physically available — this clearly relates to the design of the plant. 
This issue, of course, is not unknown in classical control engineering, and is evident in the examples below. Also, 
if one is interested in the expected behavior of the network for a range of variables X, then it may be appropriate 
to work directly with the network generator Gpacaw{X), and use the form of this generator to determine the 
controller C, given the objectives. This approach is roughly dual to a method based on master equations already 
in use, see, e.g. [30]. 

We specify the control objectives by encoding them in a non-negative observable Vd G s^p ® s^c (the parameters 
of the controllers C G are assumed to belong to ^c)> a supply rate rd(W^), and a class of exosystems Wd for 
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which a network {P A C) A W is well defined. One then seeks to find, if possible, a controller C G 'i^ such that 

GpACAwiVd) - rd{W) < (81) 

for all exosystem parameters W E Wd- In other words, one seeks a controller for which the closed loop system 
is dissipative with storage function Vd, supply rate r^iW), and exosystem class The exosystems are included 
to facilitate robust control system design for situations where uncertainty and disturbances are important. The 
observable Vd is something which on average should be small (such as regulation errors), or tend to zero as time 
evolves. The supply rate may also contain such "small" quantities, as well as terms from the exosystems. The 
supply rate need not be the natural supply rate for the network — the inequality in the dissipation inequality can be 
exploited to permit other choices. 



B. Controller Synthesis 

We shall now describe how standard problems of stabilization, regulation, and robust control fall within the scope 
of the controller synthesis framework formulated in the previous subsection. We begin with a general synthesis 
problem that abstracts stabilization and regulation, since they are closely related. These problems correspond to a 
choice Vd of a non-negative observable whose expected value we wish to go to zero as time approaches infinity. 
For definiteness, we choose rd{W) = —cVd, where c > is a suitable real number, and Wd = {(_, 0)}, which 
consists only of the trivial exosystem, so that (P A C) A Vt^ = (P A C) ffl (_, _, 0) = P A C. 

Theorem 4.1: (Stabilization/regulation) If there exists a controller C £ and non-negative observable Vd G 
jz/p (g) £/c such that the plant-controller network P AC satisfies 

QpAc{Vd)+cVd<Q (82) 
for some real c > 0, then {Vd{t)) — > as t — > oo exponentially for any plant-controller state. 



This theorem follows from the stability results give in subsection III-B 



Our next result is a general theorem concerning nonlinear quantum robust control, which generalizes 
the linear quantum results given in [17], [19]. We use an exosystem class Wd = {W : W — {l,w,0) : 
w commutes with £/p} to describe the "disturbance" inputs. The next theorem is a consequence of a slight 



extension of the Bounded Real Lemma (Theorem 3.7 1 applied to the plant-controller network P AC. 

Theorem 4.2: (H°° control) If there exists a controller C and a non-negative observable Vd G s^p ® s^c 
such that the plant-controller network P AC satisfies 

- Z'^Z > (83) 

and 

G(PAC)Aw{Vd) - g^w^w +{N + Zw)^N +Zw)-X<0 (84) 

for some real 5 > 0, A > 0, and all exosystem parameters W G Wd, then the plant-controller network P AC has 
gain g. 
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C. Design Examples 

In this section we provide some simple examples to illustrate several issues concerning feedback control design 
of quantum systems. The examples (Examples |4.3[ |4.4| l employ the series architecture shown in Figure [TT| 




Fig. 11. The plant-controller network P <iC for Examples |4.3| [44 



Our first design example is a regulation problem analogous to the classical problem of designing a controller to 
maintain a given value of capacitor charge in a RC circuit, [27]. 

Example 4.3: (Regulation) Consider an optical cavity P ~ (1, a, 0) (a damped open harmonic oscillator, Example 



3. 10 1. If the input field is a vacuum, photons initially in the cavity will eventually leak out. Suppose our control 



objective is to maintain a given non-zero value for the steady state expected photon number. Let's choose a value 
a for the desired steady-state value of a, which corresponds to a number a* a of photons (i.e., we want the cavity 
to be in a coherent state \a) in the steady-state. Appendix [b|). 

Perhaps the simplest thing to do is to provide a source of fresh photons that can be supplied to the cavity to 
replace those that are lost. This might be achieved using a laser source or modulator C — {l,i^,0) connected in 



series, as in Figure 1 1 Here, is a complex number describing the strength of the source, and is to be determined, 
if possible. 
We set 

Vd — (a — a)*{a — a) = a*a — a*a — a*a + a*a, 
and for a positive real number c, 

rd{W) = -cVd, 



with Wd ~ {(-, 0)}, which consists only of the trivial exosystem, as in Theorem 4.1 Note that the expected value 
of Vd in the state a is zero: (Q;|Vd|a) = 0. 

The design problem is to select ly, a complex number, such that 

Gp^ciVd) + cVd<0 



for suitable c > 0. Then from ( [26| the LHS of this expression is 

—a*a{l — c) + a(^ i^* — ca*) + a* {— — v — ca) + d*v + av* + cot a. 

If we set c = 1/2, J/ = ~a/2, then this expression equals — Vd/2. Therefore 

Gp^ciVd) < ~Vd/2 
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which implies that the expected value of Vd{t) tends to zero as < ^ oo (by Theorem 3.5 1, and the control objective is 



achieved (notes also that the expected value of PoC in the cavity coherent state \a) is zero: {a\Qp^c{Vd)\ct) — 0). 

The effect of the controller is to place the cavity input field in a coherent state |zy). It is well known (e.g. [10]) 
that this is equivalent to adding a Hamiltonian term to the cavity model and setting the input to vacuum. In the 



notation of this paper, this follows from (25 i and (26 1: Gp<ic{X) = Gpsci-^)' where C = (_, _, — i(i^a* — 1^*0)). 



This is illustrated in Figure 12 



□ 




Fig. 12. Alternate representation of the plant-controller network P < C in the form P EH C for Example 4.3 



The next example shows that care must be exercised when attempting to use classical control design methods. 
Furthermore, one must take account of quantum noise and the fact that physical quantities do not in general 
commute. 

Example 4.4: (Stabilization) Suppose we wish to stabilize the marginally stable system P = (l,a + a*,0), a 



special case of the open oscillators of Example 3.10 using an approach analogous to a standard method from 
classical control theory for stabilizing Hamiltonian systems, [32, sec. 4.1]. 

Consider the series plant-controller network of Figure [TT] From Example |3.10| we know that this system is 
passive; if C = (l,w, 0) then 

GpociVo) = ^u{Va) + u*Z + Z*u+ 1, (85) 



where Z = a* — a and Vq ^ a*a (recall (38 1, (64i with W — C). The classical Hamiltonian stabilization procedure 
suggests that we set 

u = -kZ (86) 
for some non-negative gain k. In order to implement this feedback, the controller C needs to have access to the 



variable Z. However, Z is not available in the output signal B, since by the output relation (21 1 dB = Ldt + dB, 
where i = a + a* . 

We suppose that the plant can be re-engineered to have a second field channel which contains Z. Specifically, 
we consider the augmented system P ffl C, where C = (1, ~kZ, 0). The desired variable is now available in the 
second output of the augmented system, and so we can form the series connection P <C = (1, (1 + k)a + (1 — 



k)a* , —ik{a — (a*) )), Figure 13 However, an examination of the dynamics of the quadratures q — a + a* and 
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p — --i{a — a*) shows that the feedback system P o C is marginally stable and not asymptotically stable for all 
k > (the feedback system has poles at and —4k). Physically, neither of the field couplings L — a + a* — q and 
—kZ — k{a ~ a*) = ikp are sufficient for strict passivity and hence asymptotic stability. 

A preferable stabilization scheme would be to replace C by C = (l,fca, 0). Then the re-engineered systems 
PSC and P <C are both strictly passive and asymptotically stable. 

Note that the ability to engineer field couplings is of fundamental importance here (see [23] for general results 
concerning physical realization in the context of linear quantum systems). 




Fig. 13. Alternative representation of the plant-controller network P < C for Exainple |4.4| 



□ 

V. Conclusions 

In this paper we have extended J.C. Willems' theory of dissipative systems to the quantum domain. The quantum 
systems we considered are open quantum models, and with the aid of recently developed methods for describing 
quantum feedback networks, we have shown how to describe external influences as arising from interactions with 
exosystems. The fundamental dissipation property was expressed in these terms. We presented an infinitesimal 
characterization of the dissipation property, which generalizes the well-known Positive Real and Bounded Real 
Lemmas. We also showed how to implement Willems' "control by interconnection" for open quantum systems 
using quantum network representations. 

We believe that the results in this paper provide useful methods for the analysis and design of quantum dissipative 
systems, and indeed networks of such systems. The quantum network based results we have presented are quite 
general and powerful, and merit further development. The network paradigm is particularly important if quantum 
technology is to move from the device and small system level to a more complex system level such as is being 
contemplated, for example, in the quantum computing community. 

Appendix 

A. Two Level Atom ( Qubit) 

The simplest quantum system has two energy levels and is often used to model ground and excited states of atoms. 
Since the advent of quantum computing, this system is also known as the qubit, the unit of quantum information. 
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The two level atom is illustrated in Figure 14 (a), showing the action of the raising (7+ and lowering (t_ operators. 
The Hilbert space for this system is H = C^, the two-dimensional complex vector space. The physical variable 
space for this system is spanned by the Pauli matrices [22, sec. 2.1.3], [10, sec. 9.1.1]: 

/io\ { \ \ [ ^ 

0-0 = ^= \ , (^x = I = \ \ , ay = I ^ \ , cr^ = / = 

yoiy yi J \ i o J yo-i 

The raising and lowering operators are defined by a± — ^{ax^icTy)- The basic commutation relations are [ax,ay] 
2i(Tz, [(Ty.az] — 2iax, and [az:Crx\ — 2iay. The energy levels correspond to the eigenvalues of az- 

. i ^ t - 

71 = 3 

Tl = 2 

'\ t - 

excited _ -j^ 



Fig. 14. Energy level diagrams, (a) Two-level atom (qbit). (b) Harmonic oscillator. 



B. Quantum Harmonic Oscillator 

The quantum harmonic oscillator is one of the most important examples because of its tractability and application 
to modeling, [22, Box 7.2], [20, sec. 10.6], [10, sec. 4.1]. Models for the optical cavity and boson fields are based 



on the quantum harmonic oscillator. The quantum harmonic oscillator is illustrated in Figure 14 (b), which shows 
infinite ladder of energy levels and the action of the creation a* and annihilation a operators. The Hilbert space for 
the quantum harmonic oscillator is H = iv^(R, C), the vector space of square integrable functions defined on the 
real line. The physical variable space jz/ for this system is defined in terms of the annihilation operator a, with a* 
the adjoint of a, and the canonical commutation relations [a, a*] = 1. The action of the annihilation operator may 
be expressed as 

(aip)(x) = xtpix) — i— ^(x) 
ax 

on a domain of functions (vectors) in H. The eigenvalues of a* a are the numbers 0,1,2,... (number of quanta), 
with corresponding eigenvectors denoted ipn (n = 0,1,2, .. .) called number states. We have aij^n = V^V'n-i and 
a*i^n = \/^ + 1 i'n+i- For a complex number a, a coherent state is defined by 

^ n V 

n— 

(Dirac notation), and satisfies the eigenvalue relation a\a) — a\a). 
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C. Operator Orderings 

In this appendix we review some definitions and results concerning operator ordering. 

Let A and B be self-adjoint operators on a Hilbert space H. Then by definition A>0 means {ip,Aip) > for 
all vectors ip E H. Using this, we say A> B to mean A — B > 0. 
Now fix A and B self-adjoint, and C is arbitrary. Assume 

w*Aw < B + w*C + C*w (87) 

for all operators w acting on H. Then we claim that A < 0. 

To verify this claim, suppose by contradiction there exists V'o G H such that 

(V'o,^^o)>0. (88) 



Now set ui = al, where a is an arbitrary real number Then ( 87 1 implies 



-(V'c^lV'o) < {iJo,B^Po) + a{i;o,{C + C*)^o)■ (89) 



Since a is arbitrary, this contradicts (88i, establishing the claim 



Now fix arbitrary operators C and D. We can use a similar argument to show that if 

w*C + C*w < D (90) 

for all operators w acting on H, then C — 0. 

Acknowledgement. The authors wish to thank Guofeng Zhang for his helpful comments. 
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